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Introduction 


Modern  control  and  entimation  theory  have  been  used  success- 
'^ully  to  develop  a model  for  human  performance  in  continuous  con- 
trol tasks  [1].  This  model,  frequently  referred  to  as  the 
optimal  control  model  of  the  human  operator,  has  been  validated 
extensively  by  experimental  data  and  has  been  applied  to  a variety 
of  problems.  The  model  incorporates  an  "internal  model"  that  is 
an  exact  replica  of  the  system  model  as  part  of  a Kalman  filter 
sub-model  that  represents  human  information  processing.  The 
concept  that  the  human  operator  builds  an  internal  model  of 
his  "universe"  (e.g.,  through  training)  is  not  uncommon  in 
psychology.  Moreover,  the  assumption  of  a perfect  internal 
model  appears  to  be  a satisfactory  one  in  many  instances,  as 
has  been  demonstrated  by  the  agreement  between  model  predictions 
and  experimental  data. 

There  are  situations,  however,  in  which  the  assumption  of 
a perfect  model  does  not  appear  suitable  and  important  app- 
lications which  would  benefit  from  allowing  for  an  internal 
model  that  is  different  from  the  system  model.  For  example, 
naive  or  untrained  trackers  may  not  have  "perfect"  models  even 
for  simpler  systems.  Tracking  of  targets  executing  deterministic 
but  unknown  motions  requires  admitting  imperfect  internal 
models  (for  the  input)  for  complete  generality.  When  a system 
failure  occurs  there  is  a change  in  the  system;  until  this 
change  is  detected  and  the  failed  system  identified  the 
operator's  model  is  different  than  the  system  model. 


In  this  note,  some  of  the  issues  and  equations  involved  in 
predicting  closed-loop  man-machine  performance  for  situations  in 
which  the  human  operators'  knowledge  of  the  system  and/or 
environment  are  imperfect  are  presented  and  discussed.  Several 
examples  to  demonstrate  some  of  the  effects  to  be  expected  when 
such  is  the  case  are  then  given.  Details  concerning  equation 
development  may  be  found  in  [2]. 
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Equations  for  Deviate  Internal  Model 

Let  the  system  to  be  controlled  by  the  human  operator 
be  described  by  the  linear  equations 

x(t)  = A x(t)  + B u(t)  + E w(t)  (1) 

y(t)  = C x(t)  + D u(t)  (2) 

where  x is  an  n^^  dimensional  vector  of  system  state  variables, 
u is  an  ny-dimensional  vector  of  control  inputs,  y is  an  ny- 
dimensional  vector  of  displayed  outputs  and  w is  an  n^-dimensional 
vector  of  a zero-mean,  gaussian,  white  nose  process  with  auto- 
covariance E{w(t]^)w'  (t2)  } = W 6{t]^-t2).  We  assume  w(t)  is 
stationary  so  that  W is  constant  for  all  t.  We  will  also  assume 
that  the  matrices  in  (1)  and  (2)  are  constant.  Thus,  we  treat 
a time-invariant  system.  Moreover,  we  will  be  concerned  here 
only  with  the  steady-state  solution. 

The  optimal  control  model  for  the  human  operator  has  the 
structure  illustrated  in  Figure  1.  The  structure  and  equations 
of  Figure  1 have  been  documented  in  [1].  The  blocks  in  Figure 
1 labeled  estimator  and  predictor  model  human  information 
processing.  For  these  processes  to  be  performed  "optimally" 
it  is  necessary  to  have  perfect  knowledge  of  the  system  {A,  B,  C, 
D,  E},  the  driving  noise-statistics  {W} , and  the  parameters 
describing  human  limitations  (x,  T^^ , Vy , Vm).  The  control  gains, 
L* , model  human  control-command  generation  or  compensation  and 
are  selected  so  as  to  minimize  a quadratic  cost  functional. 

To  achieve  a minimum,  i.e.,  to  compute  L * , it  is  necessary  to 
know  A,B  and  the  weighting  coefficients  (q{»)i).  Thus,  there 
are  three  classes  of  quantities  or  parameters  ( system/enviroment , 
own  limitations,  and  cost  weightings)  that  are  required  to  be 
known  by  the  human  operator  if  he  is  to  perform  optimally. 
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HUMAN  OPERATOR  MODEL 


Figure  1.  Structure  of  the  Optimal  Control  Model 
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There  are  many  assumptions  that  can  be  made  concerning  the 
human  operator's  knowledge  of  the  requisite  information.  At 
one  extreme,  one  can  assume  that  all  quantities  are  unknown 
(including  the  dimensions  of  the  various  matrices) . At  the 
other  end  of  the  spectrum,  one  can  assume  that  all  quantities 
are  known  and  the  human  performs  optimally.  This  latter  assump- 
tion is,  of  course,  the  one  used  in  formulating  the  optimal 
control  model;  for  trained  operators,  it  seems  closer  to  the 
truth  (or,  at  least  it  explains  the  data  better)  that  the 
assumption  of  complete  ignorance.  Here,  for  reasons  discussed 
in  [2],  we  assume  the  human  operator  knows  the  cost  functional 
weightings  and  his  own  limitations  of  delay,  neuromotor-lag 
and  observation  noise.  On  the  other  hand,  we  allow  the  system 
matrices  to  be  unknown  (even  as  to  dimension)  and  the  motor- 
noise  also  to  be  unknown. 


To  implement  the  above  assumptions,  we  assume  the  human 
operator's  internal  model  to  be 


A(t)  - z{t)  + 

^(t)  - Cj^  2(t) 


where 


C' 

D' 


" i 

1 — 
o 

H 

0 

* 

-1 

Hi  - 

0 

I., 

0 

V 

-N. 

— m. 

A B 

0 

. B,  - 

, c*  - 

—1 

-1 

~1 

0 -T„ 

T. 

L-N- 

(3) 

W 

(5) 


(6) 


where  the  matrices  with  "tildes"  indicate  internal  matrices  and 
Equations  (1)  and  (2)  have  been  "augmented"  to  incorporate  the 
"neuromotor"  dynamics  (see  Fig.  1 and  [1]).  The  perceived 
variables  remain  unchanged  inasmuch  as  the  "true"  y is  displayed 
to  the  operator.  The  "internal  state"  z does  not  have  to  be  of 
the  same  dimension  as  x.  However,  we  assume  that  y and  u in  the 
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internal  model  have  the  same  dimensions  as  the  corresponding 
vectors  of  the  system. 

It  is  now  assumed  that  the  human  will  perform  "optimally" 
for  his  internal  system.  These  assumptions  lead  to  a set  of 
coupled  del^y-dif ferential  equations.  In  the  special  case,  where 
^ and  Ci=Ci , the  following  equations  describing  closed-loop 

performance  are  obtained  [2] 


i(t)  - (A^  - K C^)  e(t)  + (Aj_  - A^)  x(t-t) 

+ w(t-t)  - K Vy(C-T) 

x(t)  - (A^  - L)  x(t)  + e^x'^  K (7) 

fC,  e(t)  + V (t-T)I 
1 — -y 

Xj^(t)  - A^  w(t)  . 


where  e(t)  is  the  state  estimation  error  and  K is  the  Kalman 
gain  for  the  system  described  by  Equations  (3)-(6).  Equation 
(7)  is  also  a "coupled"  set  of  delay-differential  equations. 

Note,  however,  that  if  “ ■^l  equation  for  the  error 

"decouples"  from  the  state  equation  and  the  estimation  equation. 
Moreover,  the  system  reduces  to  a set  of  ordinary  differential 
equations.  Performance  computations  are  thereby  simplified 
enormously  requiring  evaluation  of  n^  x nx  matrices  only. 

This  is  the  case  even  if  . Unfortunately,  the  assumptions 

required  to  achieve  this  simplification  are  too  stringent  for 
most  considerations. 

The  delay-differential  character  of  the  above  equations  can 
be  circumvented  by  approximating  the  human's  delay  via  a Fade 
approximation.  The  delay  is  then  considered  part  of  the  system 
dynamics  (except  for  computation  of  human  describing  functions) ; 
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it  is  a part  that  is  assumed  known  to  the  human  operator  so 
there  will  be  some  compensation  for  the  delay.  The  resulting 
closed-loop  equations  are  linear  and  time  invariant.  However, 
their  stability  is  not  automatically  guaranteed  as  in  the  case 
when  all  matrices  are  known  to  the  operator;  instead,  stability 
depends  on  the  particular  internal  model  selected.  The  necessary 
modifications  are  given  in  [21. 
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3 . Examples 


Inaorreot  Knowledge  of  Vehiole  Dynanrias 

In  order  to  control  a vehicle,  the  pilot  must  learn  its 
basic  response  characteristics . One  can  readily  envision  this 
as  a two-stage  process:  1)  the  development  of  an  appropriate 

structural  model  for  the  plant;  and  2)  the  adjustment  (or  fine 
tuning)  of  the  parameters  in  that  structure.  Such  a process 
is  consistent  with  the  notions  of  system  identification 
theory.  With  regard  to  structure,  the  problem  in  a multi-input, 
multi-output  plant  involves  learning  the  couplings  as  well  as 
the  basic  modes  of  response.  For  single-input,  single-output 
situations  a fundamental  issue  is  the  order  of  the  plant 
dynamics,  i.e.,  how  many  integrations  are  there  between  control 
input  and  plant  output. 

Figures  2 and  3 show  the  predicted  describing  function  and 
remnant  for  an  operator  optimizing  his  performance  based  on 
different  interiul  models  of  the  vehicle  dynamics.  In  each 
case,  the  input  disturbance  was  filtered  white  noise  with  a 
2 rad/sec  bandwidth.  In  Figure  2,  the  true  plant  dynamics  are 
K/s,  i.e.,  the  rate-of-change  of  plant  output  is  proportional 
to  the  control  input.  Three  curves  are  shown;  one  in  which 
the  operator  has  the  correct  model,  one  in  which  the  internal 
-.vr’cT  is  incorrect  (the  output  is  proportional  to  the  input), 
and  one  in  which  the  operator  has  a large  pseudomotor  noise 
[2],  The  curve  corresponding  to  having  the  correct  model  agrees 
quite  well  with  the  measured  describing  functions  for  this  case 
[1].  Note  that  the  effect  of  having  the  wrong  internal  model  is 
substantial  whereas  the  effect  of  high  pseudo  motor-noise  is 
slight  (a  reduction  in  gain  at  low  frequencies. 
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Figure  3 presents  similar  results  for  a more  complex  plant 
which  represents  the  roll-synamics  of  an  aircraft.  Results  are 
shown  for  the  case  in  which  the  operator  has  the  correct  internal 
model  and  for  the  cases  where  the  model  is  a good  approximation 
to  either  the  low  frequency  or  high  frequency  plant  response. 
Frequency  characteristics  of  the  three  vehicle  models  are  plotted 
in  Figure  4.  Again  the  results  show  that  we  can  expect  measure- 
ments of  the  pilot's  describing  functions  to  be  significantly 
different  if  operating  with  different  internal  models.  In  this 
case,  the  remnant  is  somewhat  less  revealing. 

Model  results  were  also  obtained  for  the  case  where  the 
pilot's  internal  model  of  the  aircraft  roll  dynamics  differed 
only  slightly  from  the  actual  dynamics  over  the  entire  frequency 
range  of  interest.  In  this  case  (not  shown),  differences  in 
the  above  measurements  were  not  distinguishable  from  those  that 
might  be  due  to  othe  parameter  changes. 

On  the  basis  of  these  preliminary  results,  we  believe 
that  major  structural  errors  in  the  operator's  internal  model 
of  the  plant  dynamics  can  be  inferred  by  comparing  the  measured 
describing  function  and  remnant  with  that  predicted,  by  the  OCM , 
for  a trained  operator.  Moreover,  the  form  of  the  operator's 
internal  model  may  also  be  deduced  using  the  OCM.  Major 
parameter  errors  are  also  probably  discernible.  However,  the 
fine-tuning  process  of  model  identification  may  not  be  distin- 
guished readily  from  other  factors  such  as  general  noise- 
reduction  . 
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Figure  4.  Vehicle  Dynamics  Approximations  for 
High  Performance  Roll  Dynamics 
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lAiafriinq  the  Input  Chavaateristios 


The  K/s  example  described  above  was  also  examined  to 
see  if  the  effects  of  incorrect  knowledge  of  the  input  charac- 
teristics would  be  evident.  Figure  5 gives  results  for  the 
case  in  which  the  operator  overestimates  the  input  bandwidth 
by  a factor  of  2.  It  can  be  seen  that  these  results  differ 
significantly  from  the  situation  in  which  the  input  bandwidth 
is  known  correctly  only  in  terms  of  low  frequency  gain.  If  we 
refer  to  Figre  2,  we  see  that  the  effect  is  also  different  from 
that  of  having  an  incorrect  model  of  the  vehicle  dynamics. 

Pe rcep t ua  I Effi aiency 

A major  application  of  the  wrong  internal  model  concept  would  be 
to  the  study  of  learning  of  control  strategies.  In  addition 
to  learning  the  plant  dynamics,  it  is  believed  that  skill 
development  involves  learning  to  use  the  available  cues  most 
efficiently.  We  can  envision  this  as  a process  of  proper  cue 
selection  as  well  as  noise  reduction.  For  example,  the 
progression-regression  hypothesis  [3]  suggests  an  increasing 
utilization  of  derivative  information  with  learning.  It  is 
therefore  of  interest  to  compare  the  effects  of  inefficient 
cue  utilization  and  an  incorrect  internal  model.  Figure  6 
compares  predicted  describing  functions  and  remnant  for 
optimized  performance  with  and  without  rate  information.  The 
results  are  for  the  roll  dynamics  described  earlier  and  it  is 
assumed  that  the  operator  has  learned  the  plant  dynamics.  It 
can  be  seen  that  failure  to  utilize  rate  information  has  a 
distinct  impact  on  the  measures  of  control  strategy  and 
perceptual  efficiency.  Most  of  this  impact  is  at  high  fre- 
quencies, as  expected.  Furthermore,  comparison  with  Figure  3 
reveals  that  lack  of  rate  information  produces  a decidedly 
different  result  from  that  obtained  with  a low  frequency 
approximation  to  the  vehicle  dynamics.  Thus,  it  should  be 
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possible  to  differentiate  between  learning  vehicle  dynamics  and 
learning  to  use  the  available  cues  from  these  measures  of  operator 
performance . 
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4.  Conclusion 


In  conclusion,  we  wish  to  point  out  that,  while  the  notion 
of  a deviate  internal  model  is  appealing  intuitively,  in  the 
authors'  opinion,  its  use  for  trained  operators  even  in  complex 
tasks  should  be  considered  with  caution  for  the  following  reasons 
(1)  the  assumption  of  a perfect  model  works  quite  well  for 
trained  operators  performing  well  defined  tasks;  (2)  the  obser- 
vation and  motor  noises  included  in  the  optimal  control  model 
already  account  for  some  model  imperfections;  (3)  when  there 
is  significant  process  noise,  state  prediction  and  estimation  is 
difficult  and  the  contribution  to  performance  degradation  of 
deviate  internal  models  is  likely  to  be  reduced  significantly; 

(4)  computational  requirements  for  predicting  closed  loop 
performance  may  well  increase  under  this  assumption;  and  (5) 
most  importantly,  in  order  to  avoid  having  to  choose  among  an 
infinity  of  possible  internal  models,  rules  for  picking  a 
specific  internal  model  are  needed,  and,  presently,  no  such 
rules  exist.  On  the  other  hand,  the  programs  developed  here 
and  the  insights  provided  by  the  sensitivity  analyses  should 
prove  very  useful  in  studying  and  analyzing  the  performance 
of  untrained  operators. 
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Warren,  Mississippi  48090 

Chief 

Human  Engineering  Laboratory 
Detachment 

Attn:  DRXHE-ME.  Mr.  Antenuccl, 

c/o  ORXFB-TO 

US  Army  Mobility  Equipment 

Research  and  Development  Command 
Fort  Belvoir,  Virginia  22060 

US  Army  Research  Office 
Attn;  Information  Processing 
Office 

Box  CM,  Duke  Station 
Durham,  North  Carolina  27706 

Conxnandor 

IIS  Army  Air  Defense  School 

Attn:  ATSA-CTD-M(F 

Fort  Bliss,  Texas  799l«' 


l)ircct<»r,  Development  Center 
rs  Marino  Corps  Development  and 
Education  Command 
Attn;  (.h.iirman.  Air  Operations 
Division 

tjtiant  ic^i.  Cal  i forma  22134 
Hi} 

Rome  Air  Development  Center 
Attn;  TILD 

crifflss  Air  Force  Base 
Nev  Y‘»rk  13440 

Chief 

Human  Engineering  Laboratory 
Detachment 

Attn;  DRXHK-AM,  Mr.  Miles 
I'.  Army  Systems  An.alysis  Activity 
A(h  rdeen  Proving  i. round 
Maryland  2liK)5 


Conmander 

Rock  Island  Arsenal 
Attn;  SARRl-LP-L,  Technical 
Library 

Rock  Island,  Illinois  <>1201 
Ca)mm.indor 

US  Army  Electronics  Conmand 
Attn:  DRSEt.-PA-RH.  Mr.  Baron 

Fort  Monmouth,  New  Jersey  0770) 

Library 

I’S  Army  War  College 
Carlisle  Barracks 
Pennsylvania  17013 

Director 

US  Army  Ballistic  Kesearch 
Laboratory 
Attn;  ORXBR-EB 
Aberdeen  Proving  Ground 
Maryland  21005 
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Army  Research  Institute  Field 
Unit 

Attn:  Dr.  Robert  W.  Bauer 

RullJlni;  2423 

Fort  Knox,  Kentucky  40121 


Department  of  Transportation 

Library 

Referent c ami  Kesi-arch  Branch, 
TAD-494. b 

bOU  I ndependem  ••  Avenue  SW 
Washinf^tr.n,  D.f.  20591 

LIS  postal  Service  Laboratory 
Attn;  Mr.  D.V . CornoR 
Chief,  HF  Crou)» 

117U  Parklawn  Drive 
Rockville,  Maryland  20852 

Mr.  tdgar  M.  lohnson 
US  Army  Research  Institute 
Room  2 19  The  Commonwealth 

Bui  Iding 

D20  Wilson  Boulevard 
Arlington,  Virginia  22209 

Federal  Aviation  Administration 
(ivil  Aeromedical  Instittite  Library 
AC-lOl.l,  P.  0.  Box  25082 
ORlalu^m.i  (ity,  Oklahoma  7 1125 

Ocparlmcnt  of  Operations  Analysis 
Naval  PosCfiraduace  School 
Attn:  Professor  James  K.  Ariroa 

Monterey,  California  93940 

Comnander 

USAVSCOM  , ^ 

Attn;  DRSAV-R-F,  Mr.  S.  Moreland 
P.  0.  Box  209 

St.  Louis,  Missoviri  b'llhb 
Diri-ctor 

Nav.ii  Kescarth  I.aboratory 

At tn;  Code  51  12A 

Wash  inplou , D.«  . 20  190 

Conmanding  Officer 
Naval  Training  Equipment  Center 
Attn:  Tcclmical  Library 

Orlando,  Florida  12811 

6.170  AMRL 
Attn:  ^^RHE 

MRtlK,  Dr.  M.  1.  Warrick 
MKMER,  Nr.  C.  Bates,  Jr. 
Wrlght-Patterson  Air  Force  Rase 
Ohio  45511 

AF  Flight  Dynamics  Laboratory 
Attn;  ! DCR  (CDIC) 

AFFDC-FCK,  LT  Greg  Peters 
Wright-Patterson  Air  Force  Base 
ol»lo  45433 


Director 

US  Anny  Human  Engineering 
Laboratory 
Attn;  DRXHE-DBD 
Aberdeen  Proving  Ground 
Maryland  21005 

Medical  Library,  Building  148 
Naval  Submarine  Medical  Research 
Laboratory 

Box  900,  Submarine  Base  New  London 
Croton,  Connecticut  06140 

Code  455 

Office  of  Naval  Research 
Washington,  D.C.  20360 

Dr.  Marshall  J.  Farr 
Associate  Director,  Personnel  and 
Training 
Code  458 

Office  of  Naval  Research 
Washington,  D.C.  20360 

Coninandant 

US  Anny  Artillery  and  Missile 
School 

Attn:  LISAAMS  Technical  Library 

Fort  Sill,  Oklahoma  73503 

ARI  Field  Unit 
p.  0.  Box  6057 
Fort  Bliss,  Texas  79916 

Commander 

Fort  Huachuca  Support  Conmand, 

US  Army 

Attn:  Tech  References  Division 

Fort  Huachuca,  Arizona  85613 

Ciximandcr 

Attn;  Technical  Library 
White  Sands  Missile  Range 
New  Mexico  88002 

Director 

USA  Air  Mobility  Research  and 
Dcvcl(’pmcnt  Laboratory 
Attn;  Dr.  Richard  S.  Dunn 
Ames  Research  Center 
Moffett  Field,  California  94015 

Commander 

US  Armv  Electronics  Conwand 
Attn;  ORSEL-VL-E 

Fort  Monmouth.  New  .lerscy  07701 
Director 

Military  Psychology  and 
Leadership 

United  States  Military  Academv 
West  Point,  New  York  10996 

lU'ninandcr 

Watervllet  Arsenal 
Attn;  SWEWV-ROT 
Watervllet.  New  York  U1B9 

Conmandor 
Frankford  Arsenal 
Attn:  library  (C2500, 

milldinR  51-2) 

Pl.iladclptaa,  Pennsylvania  19117 
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ARl  FlclU  Unit 
Attn:  Library 

Fort  Knox,  Kentucky  40121 

Coninander 

US  Array  Tank- Automotive  Contnand 
Attn:  DRSTA-RHFL,  Research 

Library 

Warren,  Mississippi  48090 
Conmander 

US  Army  Tank- Automotive  Cotra^and 

Attn;  ORSTA-R 

'.Jarron,  Mississippi  48090 

Director  of  Graduate  Studies 
and  Research 

Attn;  behavioral  Sciences 
Representative 
US  Army  Coiranand  and  General 
Staff  CollcRe 

Fort  Leavenworth,  Kansas  6602? 

US  Army  AftCncy  for  Aviation 
Safety 

Attn:  Librarian 

Fort  Rucker,  Alabama  36360 

Chief 

Array  Research  Institute 
P.  0.  Box  476 

Fort  Rucker,  Alabama  36  J60 
C«>mnandcr 

US  Army  Acromcdical  Research 
Laboratory 
p,  0.  Hox  577 
Attn:  Dr.  Kent  Kltsball 

Library 

Fort  Rucker,  Alabama  36360 

US  Army  Natick  Research  and 
Development  Command 
Attn;  Tech  Library  (DRXNM-STL) 
N.atick,  M.'i.ssachiisctts  01760 

US  Army  Natick  Research  and 
Development  (;<«rfnand 
Beltavioral  Sciences  Division 
Attn:  ORXNM-PRII 

D*U(NM-PRBE 

Natick,  Massachusetts  01760 

US  Army  Medical  liioenKlneerinR 
Research  and  Development 
Laboratory 

Fort  Dclrlck,  IhilldlnR  568 
Kridcrltk,  Maryland  21701 

Commander 

US  Armv  Training  Device  ARCncy, 
•;aval  TraininR  Kqulpmont 
renter 

Attn:  Code  N2A 

Orlando,  Florida  12813 


US  Army  Infantry  School  Library 
Infantry  Hall 

Fort  Bcnning,  Georgia  31905 

Project  Manager 
Office  of  the  Project  Manager 
for  Training  Devices 
Attn;  DRCPM-TND.  Dr.  R.E,  Odom 
Fort  Banning,  Georgia  31905 

Defense  Documentation  Center 
Cameron  Station 
Alexandria,  Virginia  22314 

Conmander 

US  Army  Materiel  and  Readiness 
Conmand 

Attn;  DRCRD 
DRCDL 

5001  Elsenhower  Avenue 
Alexandria,  Virginia  22333 

Bolt,  Beranek  and  Newman  Inc. 
Attn:  Dr.  S.  Baron 

Dr.  D.  Klelnmas 
Dr.  J.  Ballser 
50  Moulton  Street 
Cambridge,  Maryland  02138 

DRXHE-MI,  Mr.  Chaikin 

DRCPM-HFE 

-ah 

-MPE 

-LDE 

-ROL-E 

-RK 

-HEL-T 

-TOE 

-MU 

ORSm-LP,  Mr.  Voigt 
-U 

DRI)Fa-X,  Dr.  McDaniel 
-T,  Dr,  Kobler 
-11 
-Y 
-YD 
-YT 
-TD 
-TDC 
-TOD 
-TOF 
-TDK 
-TOR 
-TOS 
-TOW 

-TUW,  Mr.  Dickson 

-TE 

-TG 

-TL 

-TPN,  L.  Aymett 
-THU 

•T1  (Record  Sot) 
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